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Description 



Method for Fast Design of 
Multi-objective Frequency-shaping 
Equalizers 

Cross Reference To Related Applications 

[0001] This application claims the benefit of PPA No. 

60/468,354, filed on May 6, 2003, by the present inven- 
tors. 

Federal Research Statement 

[0002] The original research work was done in Stanford Univer- 
sity, and was supported by National Science Foundation, 
with ECS-0000541. Stanford University shall hold the 
patent rights. 
Background of Invention 

The Field of the Invention 

[0003] This invention relates to the fields of communication, 

control, and signal processing engineering, specifically to 
the design of equalizers to compensate for the undesired 



frequency response of a system. Some of the related fields 
include 330/304, 333/28, 340/825.71, 375/229, and 
700/44. 
Background Information 

[0004] | n the fields of communication and signal processing en- 
gineering, equalizers are widely used to adjust the ampli- 
tude and the frequency spectrum of input signals, to 
compensate for the limited bandwidth or the undesired 
dynamics of a physical system such as a communication 
channel. For example, in many audio playback systems, 
pre-equalizers are used to modify the relative amplitudes 
at different frequency bands of the audio source signal 
(e.g., from a play out of a audio compact-disk player), to 
compensate for the non-ideal frequency response of the 
audio amplifier and the audio speaker, such that the hu- 
man listener can hear less distorted sound versus the 
originally recorded sound in the audio compact-disk. In 
many audio recording systems, post-equalizers are used 
to compensate for the undesired frequency response of 
the microphone, before the audio signal is physically 
recorded on the recording media. Fig. 1A and Fig. 2A show 
examples for designing a post-equalizer and a pre- 
equalizer, respectively. 



[0005] | n the field of control engineering, pre-equalizers are in- 
terchangeably referred as pre-fi Iters, feed-forward filters, 
command-shaping filters, input-shaping filters, and feed- 
forward controllers. For example, pre-equalizers are used 
in the positioning control of the read/write heads of data 
storage systems, such as a hard-disk drive or an optical- 
disk drive used in a modern personal computer. The posi- 
tion seeking commands are filtered by a pre-equalized 
before being sent to drive the voice-coil actuator. The 
pre-equalizer suppresses the spectrum contents of the 
seeking command that are located close to the resonant 
frequencies of the voice-coil actuator and the mechanical 
structure supporting the read/write head, in order to re- 
duce the oscillatory response of the resulting positioning 
trajectory, and the induced vibration due to the resonant 
modes. 

[0006] As another example: In the semiconductor manufacturing 
equipment industry, equipment engineers are responsible 
for improving the performances of many subsystems from 
various vendors, while integrating them into a larger man- 
ufacturing machine. Usually these subsystems already 
have feedback controllers provided by their vendors. For 
example, in a photo-lithography exposure machine, it is 



typical to find a temperature control system, wafer stage 
control system, and a vibration control system, etc. The 
said equipment engineers may find these controllers only 
provide moderate system performances. In this case, in- 
stead of replacing the feedback controllers immediately, 
the feed-forward controller is preferred during the initial 
redesign process, because it can be used in parallel with 
the existing feedback controllers. The said equipment en- 
gineers can measure the dynamic response of the original 
subsystems, and then design a feed-forward controller to 
improve its performances. 
[0007] ideally, an equalizer could be designed to simply inverse 
all the undesired dynamics of the physical system, such 
that the dynamics of the compensated system is satisfac- 
tory. In practice, many factors constrain the feasibility of 
this method. For example, the undesired dynamics may 
contain an unstable zero, whose inversion results in an 
unstable pole in the equalizer which causes the system 
response to diverge. The undesired dynamics may have 
more poles than zeros, such that its inverse is non-causal, 
which is not desirable if future input is not known in ad- 
vance. In addition, pole-zero cancellation only works well 
when an accurate parametric model of the system is avail- 



able. Furthermore, even if a perfect inversion equalizer 
can be implemented, the physical limit on actuator efforts 
and the presence of noise can severely degrade the per- 
formance of the compensated system. 
[0008] | n general, there are at least four factors to consider when 
designing an equalizer: l.the tradeoff between different 
performance objectives;2.the awareness of the input sig- 
nals entering the equalizer in advanced;3.the availability 
of an accurate parametric model of the physical system to 
be equalized; 4. the computational efficiency of the design 
algorithms. 

[0009] The tradeoff between different performance objectives is 
common in many engineering design problems. In the 
case of designing pre-equalizers, the tradeoff between 
the performance of the equalized response and the mag- 
nitude of actuating signals entering the physical systems 
is fundamental as in most control systems. For example in 
Fig. IB, the channel H can represent the combined dynam- 
ics of an audio amplifier and an audio speaker in the af- 
ford-mentioned audio system. There is a physical satura- 
tion limit on the amplitude of the signal u coming into the 
amplifier. Therefore when designing the pre-equalizer Q, 
both z , which is the difference between the desired out- 



put d and the equalized channel output, and z^, which is 
the equalizer output signal u, need to be minimized. A 
performance tradeoff between the two objectives is nec- 
essary. In the case of post-equalizers, the tradeoff be- 
tween the performance of the equalized response and the 
amplification of noise is fundamental as in most commu- 
nication systems. For example in Fig. 1A, H can represent 
the dynamics of an audio recording channel from the 
sound being recorded to the microphone output. Because 
the electrical signal coming from a microphone is typically 
weak, some noise will be added due to the requirement 
of high-gain amplification. The level and the spectrum of 
the noise need to be considered. Otherwise, the post- 
equalizer Q can significantly amplify the noise such that 
the audio signal w i is indistinguishable. Therefore, it is 
desirable that a design algorithm provides some tradeoff 
capability between multiple performance objectives. 
[0010] if the input signals to a system are know in advance, in- 
stead of designing a pre-equalizer, a set of optimal 
shaped commands can be directly computed by the 
method in [Tuttle, et al, U.S. Patent 6,694,196, Feb. 17, 
2004], and [S. Boyd, et al, "Control applications of nonlin- 
ear convex programming," Journal of Process Control, 



8(5-6):313-324, 1998]. Similarly, in the application of 
post-compensating a non-perfect communication chan- 
nel, if all the signals coming out of the communication 
channel are already known, the original signal can opti- 
mally estimated directly without designing a post- 
equalizer first, using basic least-square estimation tech- 
niques shown in [T. Kailath et al, Linear Estimation, 2000]. 
1 ] However, there are many cases when there is not much 
known about the input signal in advance, or when it is im- 
practical to employ all the possible input command into 
the design of the feed-forward filter or the shaped input 
command. In these cases, the designer can not formulate 
exact constraint equations which specify the limit of the 
equalized system output, because the equalized system 
output depends on both the system dynamics and the in- 
put command. For example, in the afford-mentioned au- 
dio pre-equalizer application, because the audio signals 
stored on different audio compact disks are different from 
each other, it should not be considered as known in ad- 
vance when designing the audio pre-equalizer in practice. 
In addition, for an audio compact disk storing 74 minutes 
of two-channel audio digitally sampled at 44.1 kilo-hertz, 
there are about 196 million samples of data per channel. 



Solving an optimization problem at such dimension is al- 
most infeasible in practice. Another example is designing 
the feed-forward controller for the photo-lithography 
mask writer used in semiconductor manufacturing. For a 
30mm-by-20mm exposure field with a 10 nanometer 
grid, there are about 12-tera pixels need to be written to 
a photo mask. Although the locations of these pixels are 
known in advance, the problem dimension is so large that 
it is impractical to apply convex optimization techniques. 

[° 012 ] In short, when the input signal can not be known in ad- 
vance, the afford-mentioned approaches to directly opti- 
mize the shaped commands or signal estimation can not 
work. Therefore, an equalizer should be used. Further- 
more, performance constraints should be specified in the 
frequency-domainin such case. These call for a need for 
designing frequency-shaping equalizers. 

[0013] Many of the prior arts concerning equalizer design require 
a parametric model (e.g., a transfer function in the pole- 
zero form) of the system under control. The parametric 
model usually comes from applying model fitting to the 
data obtained by performing an input-output test on the 
system. For systems with complicated dynamics, some 
mismatch between the resulting parametric model and the 



actual dynamic behavior of the system can be significant. 
For a design algorithm that uses such parametric models, 
the resulting system performance can be significantly dif- 
ferent from what is predicted in the design phase. There- 
fore, it is desirable that an equalizer design algorithm can 
directly incorporate the input-output test data of the sys- 
tem to be equalized. One type of such input-output test 
data is the frequency response measurement at a set of 
selected frequencies. For a linear time invariant system, it 
can be measured accurately, no matter how complicated 
the system dynamics is. It is desired to directly incorpo- 
rate the frequency response data in the equalizer design 
process. 

[0014] Furthermore, the computational efficiency of an equalizer 
design method should be considered. For a low-cost em- 
bedded computer system, the processing power and the 
available memory are usually quite limited. In addition, if 
the equalizer needs to be redesigned periodically possibly 
due to the change of dynamics, it is desirable that the 
computation algorithm involved is as simple and efficient 
as possible. 

[0015] Among some of the prior arts related to the equalizers 

designs, the zero phase error tracking control proposed in 



[M. Tomizuka, "Zero phase error tracking algorithm for 
digital control," ASME J. Dynamic Systems, Measurement, 
and Control, vol. 109, no. 1, pp. 65-68, 1987] is capable 
of handling non-minimum-phase zeros, and it can have 
some optimal preview action for input commands that can 
be known in advance. However, it requires a parametric 
system model, and it does not provide a means to tradeoff 
between equalized performance and control efforts. The 
input-shaping technique [N. Singer and W. Seering, "Pre- 
shaping command inputs to reduce sys-tem vibration," 
ASME J. of Dynamic Systems, Measurement, and Control, 
Vol. 112, March 1990, and Singer, et. al. U.S. Pat. No. 
4,916,635, Apr. 10, 1990 and 5,638,267, Jun. 10, 1997] 
can be used to generate a FIR (finite impulse response) fil- 
ter to cancel the unwanted vibration modes of a system, 
when the input command is known in advance. It does not 
require a parametric model of the system. However, there 
is no means for afford-mentioned performance tradeoff. 
Many standard methods for designing both MR and FIR 
digital equalizer are presented in [A. Oppenheim and R. 
Schafer, Discrete-Time Signal Processing, 2nd ed. 1999]. 
None of them provide a means for afford-mentioned per- 
formance tradeoff between different input-output chan- 



nels. 

[0016] Adaptive signal processing techniques can be used to de- 
sign post equalizers as shown in [B. Widrow et al, Adaptive 
Signal Processing, 1985], and to design pre-equalizers as 
shown in [B. Widrow and E. Walach, Adaptive Inverse Con- 
trol, Prentice Hall, 1996]. Essentially no prior knowledge 
about the system dynamics is required, due to the use of 
adaptive algorithms. It tracks the dynamics variation of 
slow-varying systems. The adaptive algorithm itself is 
quite simple. However, it dose not provide performance 
tradeoff capabilities. 

[0017] | n [t_ c. Tsao, "Optimal feed-forward digital tracking con- 
troller design," ASME J. Dynamic Systems, Measurement., 
and Control, vol. 116, no. 4, pp. 583-592, 1994], the pre- 
equalizer design problem is transformed to a model- 
matching control problem in the frequency domain, by re- 
drawing block-diagrams to formulate a generalized con- 
trol design block diagram as shown in Fig IC. Examples of 
formulating a generalized control design block diagram 
can be found in many control engineering textbook, such 
as [S. Skogestad et al, Multivariate Feedback Control, 
1996], [S. Boyd et al, Linear Controller Design: Limits of 
Performance. Prentice-Hall, 1991], and [K. Zhou, Essen- 



tials of Robust Control, 1998]. Performance tradeoff in the 
frequency domain is possible. However, it can not directly 
incorporate the frequency response measurement. In 
[Giusto and F. Paganini, "Robust synthesis of feed-forward 
compensators," IEEE Transactions on Automatic Control, 
44(8), Aug. 1999], a frequency-domain robust synthesis 
approach is proposed to deal with modeling errors in 
terms of structured model uncertainty in a robust synthe- 
sis framework. The curve-fitting errors to measured fre- 
quency data can be incorporated. However, it is well 
known in the robust control community that the computa- 
tion algorithm, known as u-synthesis, is complicated, and 
its convergence can be quite slow. 
[0018] Convex optimization techniques can be applied to opti- 
mally design multi-object frequency-shaping equalizers 
with frequency response data incorporated directly. Some 
of the related prior work includes [B. Rafaely et al, "H /H 
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active control of sound in a headrest: design and imple- 
mentation," IEEE Trans. Control System Technology, vol. 7, 
no. 1, Jan. 1999][P. Titterton, "Practical method for con- 
strained-optimization controller design: H or H opti- 

2 oo 

mization with multiple H and/or H constraints," IEEE 

2 oo 

Proceedings of ASILO 1996][P. Titterton, "Practical multi- 



constraint H controller synthesis from time-domain 

00 

data," International J. of Robust and Nonlinear Control, 
vol. 6, 413-430, 1996][S. P. Wu et al, "FIR filter design via 
spectral factorization and convex optimization," in Ap- 
plied Computational Control, Signal and Communications, 
1997][K. Tsai et al, "DQIT: u-synthesis without D-Scale 
Fitting," American Control Conference 2002, pp. 
493-498][S. Boyd et al, Linear Controller Design: Limits of 
Performance. Prentice-Hall, 1991] and [S. Boyd et al, "A 
new CAD method and associated architectures for linear 
controllers," IEEE Transactions on Automatic Control, 
vol.33, p.268, 1988]. 
[0019] The method starts with transforming equalizer design 
problems to a generalized control design block diagram 
as shown in Fig. IC, in general using a technique known 
as Q-parameterization or Youla-parameterization. Both of 
the pre-equalizer and the post-equalizer design problems 
in Fig. IB and Fig. 1A can be easily transformed by simply 
redrawing block diagrams. Fig. 2 shows the general case 
that includes the design of pre-equalizers, post- 
equalizers, and feedback controllers in the same frame- 
work. When feedback control is needed, a stabilizer J sta- 
bilize the system, while the equalizer Q is used to adjust 



the system response without causing instability, as long 
as Q itself is stable. The system 210, which is the combi- 
nation of P and J, is equivalent to the system N in Fig. 1C. 
Once the design problem has been transformed to the 
form in Fig. 1C, it can be shown that in the frequency do- 
main, the exogenous output z is related to the exogenous 
input w as z = (N +N QN )w, where N is the sub- 

zw zy uw zw 

part of N transferring from w to z, is the sub-part of 
N transferring from y to z, and N is the sub-part of N 

u w 

transferring from w to u. The important aspect is that at 
each frequency, the equalized, closed-loop transfer ma- 
trix from w to z is (N +N QN ), which is convex in 

zw zy uw 

terms of the frequency response of Q at the same fre- 
quency, the equalizer to be designed. Therefore, fre- 
quency-shaping specifications and the tradeoff between 
different input-output channels can be specified as con- 
vex objectives and convex constraints when formulating a 
multi-objective optimization problem. In addition, the 
frequency response data of N , N , and N can be in- 

zw zy uw 

corporated without curve-fitting them first. 
[0020] Although there is no single prior-art publication explain- 
ing all the details of each step involved, Fig. 3 shows a 
typical flowchart of this approach, which assembles each 



of the steps distributed in the afford-mentioned prior-art 
publications. First in step 310, the block diagram in the 
form of Fig. 1C is determined, and input-output channels 
for performance tradeoff are specified. In step 320, fre- 
quency-shaping performance specifications are specified 
on their corresponding input-output channels at a set of 
selected frequencies, and a multi-objective convex opti- 
mization problem is defined. In step 330, the frequency 
response data of N , N , and N , at a set of selected 

zw zy uw 

frequencies, are incorporated into the equalized transfer 
matrix N +N QN . In step 340, the convex optimization 

zw zy uw 

problem is solved to simultaneously optimize all the mag- 
nitude and the phases of the equalizer Q at the selected 
frequencies. In step 350, the equalizers coefficients are 
derived from the magnitudes and phases by either using 
curve-fitting, or by computing their inverse discrete 
Fourier transform. 
[0021] The convex optimization method mentioned above will 

provide a solution of the equalizer Q that approaches the 
globally optimal equalizer as long as the degree of free- 
dom of Q is large enough, and the number of selected 
frequencies is sufficient. For example, if Q has a finite im- 
pulse response (FIR) structure, the degree of freedom of Q 



is related to the number of FIR taps to be optimized. The 
sufficiency of the number of selected frequencies is to re- 
duce the ripple of frequency response in-between adja- 
cent selected frequencies. 
[0022] Unfortunately, the dimension of the optimization problem 
grows significantly with the degree of freedom of Q, and 
the number of frequencies selected. In general, significant 
computational resources are required in step 340, even 
though many efficient convex optimization algorithms 
have been proposed. When the equalizer decision vari- 
ables are specified as the coefficients of the FIR taps, they 
need to be related to the equalizers frequency response 
by discrete Fourier transform in order to formulate the 
performance constraint equations in the frequency do- 
main. Similarly, when the equalizer decision variables are 
specified as the real part and the complex part of the 
sampled frequency response of the equalizer, they need 
to be related to each other by the Hilbert transformation 
relation such that they correspond to the frequency re- 
sponse of a causal and stable system. These transform re- 
lations make the decision variables couple to each other, 
and hence the problem dimension grows with the number 
of selected frequencies and the number of the equalizer 



decision variables. Some examples can be found in [K. 
Tsai et al, "DQIT: u-synthesis without D-Scale Fitting," 
American Control Conference 2002, pp. 493-498]. Solving 
such kind of large-dimension optimization problems usu- 
ally requires a high-performance computer with sufficient 
memory. Therefore, it is not easy to implement the 
method in Fig. 3 in a low-cost embedded system, or for 
real-time equalizer adaptations as shown in [B. Widrow 
and E. Walach, Adaptive Inverse Control, Prentice Hall, 
1996, chapter 8 tolO]. 
[0023] Concluding the discussions so far: For the cases when the 
input signal can not be known or can not be practically 
treated as known in advance, what is desired for a feed- 
forward filter design approach is to formulate the design 
problem in the frequency domain, and to allow the de- 
signer to compensate for the undesired system frequency 
response as much as possible, while limiting the actuator 
effort in the frequency domain to a reasonable amount. It 
gives the designer the ability to tradeoff between the ac- 
tuator effort and the system performance without know- 
ing the detail of the input command. In addition, it is de- 
sired that the approach does not require a parametric 
model (such as an infinite-impulse-response transfer 



function) of the system, instead just employ the frequency 
response data of the system directly, which can be mea- 
sured accurately. Therefore, the actual system perfor- 
mance with the implemented equalizer can be less sensi- 
tive to the modeling or curve-fitting errors. This can be 
done by directly incorporating the accurately measured 
system frequency response in the design process without 
the loss of fidelity due to parametric model fitting. These 
requirements can be satisfied by applying afford- 
mentioned multi-objective convex optimization technique 
to optimize the equalized transfer matrix (N +N QN ) 

zw zy uw 

at a set of frequencies. This in general solves the multi- 
objective frequency-shaping design problems for pre- 
equalizers, post-equalizers, and even the equalizers in 
Fig. 2 for feedback control. Unfortunately, the dimension 
of the optimization problem grows significantly with the 
number of frequencies selected and the number of the 
equalizer decision variables to be optimized. Therefore, it 
is not easy to implement such method in a low-cost em- 
bedded computer system. The invention discloses meth- 
ods to decouple the dependency between equalizer deci- 
sion-variables, which makes it highly efficient to imple- 
ment, comparing to the afford-mentioned convex opti- 



mization method. 
Summary of Invention 

[0024] a method for fast design of frequency-shaping multi- 
objective equalizers is disclosed. The main advantages of 
this method include: 1. It does not require the designer to 
specify all the possible input commands; 2. It does not re- 
quire the designer to provide a parametric model of the 
system. It incorporates the frequency response of the sys- 
tem directly, which can be measured directly from the 
system, or computed from the parametric model of the 
system, if such parametric model is available; 3. It allows 
for the tradeoff between the system output performance 
and the magnitude of the equalizer output or the noise 
amplification in the frequency domain, by designing dy- 
namic performances weights for each of the correspond- 
ing input-output channels; 4. It is computationally effi- 
cient, due to that it first solves the magnitudes of the 
equalizer frequency response independently at each of a 
set of selected frequencies, then solves the phases using 
efficient signal processing algorithms. 

[0025] one embodiment for of the invention includes first con- 
straining the frequency response of Qto be real or non- 
negative, when optimizing the equalized transfer matrix N 



+ N QN at each of a selected set of frequencies. This is 

zy uw 

equivalent with only optimizing the magnitudes of the 
equalizer frequency response. Then, the phases of the 
equalizer are recovered by efficient signal processing al- 
gorithms such as complex cepstrum explained in [A. Op- 
penheim and R. Schafer, Discrete-Time Signal Processing, 
2nd ed. 1999], such that the magnitudes and the phases 
correspond to the frequency response of a stable system. 
[0026] | n another embodiment, the frequency response of Q are 
first constrained to be real or nonnegative, and each se- 
lected frequency, an equality is defined to approximate 
the multiple requirements that a number of different en- 
tries of the equalized transfer matrix need to be close to 
zero. The magnitudes of the equalizer are first solved in- 
dependently at each selected frequency, then the phases 
are recovered by efficient signal processing algorithms 
such as complex cepstrum, such that the magnitudes and 
the phases correspond to the frequency response of a 
stable system. 

[0027] Although many details have been included n the descrip- 
tion and the figures, the invention is defined by the scope 
of the claims. Only limitations found in those claims apply 
to the invention. 



Brief Description of Drawings 



[0028] Figure 1A is a prior-art block diagram for designing post- 
equalizers. 

[0029] Figure IB is a prior-art block diagram for designing pre- 
equalizers. 

[0030] Figure 1C is a prior-art block diagram for a generalized 
control design problem which can include both equalizer 
design problems and feedback control problems in the 
same framework. 

[0031] Figure 2 is a prior-art block diagram showing a general- 
ized control design problem when feedback stabilization 
is involved. 

[0032] Figure 3 is a prior-art flowchart for designing a multi- 
object frequency-shaping equalizer by applying convex 
optimization techniques to simultaneously optimize all 
the magnitudes and phases of the equalizer frequency re- 
sponse in one high-dimensional optimization problem. 

[0033] Figure 4 is a flowchart as one example of one embodiment 
of the invention, for designing a multi-object frequency- 
shaping equalizer by first applying convex optimization 
techniques to independently optimize each magnitude of 
the equalizer frequency response at each frequency in a 
low-dimensional optimization problem, and then generate 



the phases using efficient signal processing techniques, 
such that all the magnitudes and the phases correspond 
to a stable system. 

[0034] Figure 5 is a flowchart as one example of another embodi- 
ment of the invention, for designing a multi-object fre- 
quency-shaping equalizer by independently solving each 
magnitude of the equalizer frequency response at each 
frequency in a low-complexity tradeoff equality, and then 
generate the phases using efficient signal processing 
techniques, such that all the magnitudes and the phases 
correspond to a stable system. 

[0035] Figure 6A is a prior-art block diagram showing a mixed- 
sensitivity feedback control design problem, which moti- 
vates the derivation of the method in Fig. 5. 

[0036] Figure 6B is a block diagram showing an example for de- 
signing a multi-objective frequency-shaping pre- 
equalizer to improve the frequency response of an exist- 
ing feedback-control system, using the design method il- 
lustrated in the flowchart of Fig. 5. 

[0037] Figure 6C illustrates the similarity between the mixed- 
sensitivity feedback control design in Fig. 6A and the 
multi-objective equalizer design in Fig. 6B. 

[0038] Figure 7A is a plot of the frequency response data of the 



existing feedback-control system in Fig. 6B. 
[0039] Figure 7B is a plot of the designed magnitudes and phases 
of the pre-equalizer in Fig. 6B, and their low-order curve- 
fitting with a sixth-order stable and minimum-phase sys- 
tem. 

[0040] Figure 8A is plot of all the poles and zeros of the low- 
order curve-fitting sixth-order system in Fig. 7B, to con- 
firm that all of them are within the unit-circle. 

[0041] Figure 8B compares the 40-nanometer step responses of 
the original existing feedback control system, the result- 
ing equalized system, and the reference model in the de- 
sign example of Fig. 6B. 

[0042] Figure 9A shows the 2-micrometer step responses of the 
resulting equalized system and the reference model, and 
the magnitudes of the pre-equalizer output u in the de- 
sign example of Fig. 6B. 

[0043] Figure 9 B shows the magnitudes of the pre-equalizer 

output u in the design example of Fig. 9B can be signifi- 
cantly reduced by designing a second pre-equalizer in 
front of the first pre-equalizer. 
Detailed Description 

An Overview of an Embodiment of the Invention 



[0044] a method for fast design of frequency-shaping multi- 
objective equalizers is disclosed. One embodiment for of 
the invention includes first constraining the frequency re- 
sponse of Qto be real or nonnegative, when optimizing 
the equalized transfer matrix N +N QN at each of a 

zw zy uw 

selected set of frequencies. This is equivalent with only 
optimizing the magnitudes of the equalizer frequency re- 
sponse. Then, the phases of the equalizer are recovered 
by efficient signal processing algorithms such as complex 
cepstrum, such that the magnitudes and the phases cor- 
respond to the frequency response of a stable system. In 
another embodiment, the frequency response of Q are 
first constrained to be real or nonnegative, and each se- 
lected frequency, an equality is defined to approximate 
the multiple requirements that a number of different en- 
tries of the equalized transfer matrix need to be close to 
zero. The magnitudes of the equalizer are first solved in- 
dependently at each selected frequency, and then the 
phases are recovered by efficient signal processing algo- 
rithms such as complex cepstrum explained in [A. Oppen- 
heim and R. Schafer, Discrete-Time Signal Processing, 2nd 
ed. 1999], such that the magnitudes and the phases cor- 
respond to the frequency response of a stable system. 



[0045] An example design flowchart in Fig. 4 is provided for the 
first embodiment. Another example design flowchart in 
Fig. 5 is provided for the second embodiment. Comparing 
with the prior-art design flow chart in Fig. 3, the design 
steps that appear in both the prior-art and the invention 
will only be briefly explained since their details can be 
found in several prior-art references. 

[0046] a practical design example following the example design 
flowchart in Fig. 5 is described to demonstrate the effec- 
tiveness of the algorithms disclosed in the invention. 
Defining Equalizer Design Multi-objective Optimization 

Problems per Prior-Arts 

[0047] Comparing the prior-art design flowchart in Fig. 3 and the 
two examples design flowcharts in Fig. 4 and Fig. 5, it is 
found that step 310 is identical to step 410 and step 510, 
step 330 is identical to step 430 and step 53 0. Both step 
420 and step 5 20 are derived from step 320. Hence step 
310, step 320, and step 330 are briefly described. Some 
prior-art publications include: [B. Rafaely et al, "H /H 
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active control of sound in a headrest: design and imple- 
mentation," IEEE Trans. Control System Technology, vol. 7, 
no. 1, Jan. 1999][P. Titterton, "Practical method for con- 
strained-optimization controller design: H or H opti- 



mization with multiple H and/or H constraints," IEEE 

2 oo 

Proceedings of ASILO 1996][P. Titterton, "Practical multi- 
constraint H controller synthesis from time-domain 

00 

data," International J. of Robust and Nonlinear Control, 
vol. 6, 413-430, 1996][S. P. Wu et al, "FIR filter design via 
spectral factorization and convex optimization," in Ap- 
plied Computational Control, Signal and Communications, 
1997][K. Tsai et al, "DQIT: u-synthesis without D-Scale 
Fitting," American Control Conference 2002, pp. 
493-498][S. Boyd et al, Linear Controller Design: Limits of 
Performance. Prentice-Hall, 1991] and [S. Boyd et al, "A 
new CAD method and associated architectures for linear 
controllers," IEEE Transactions on Automatic Control, 
vol.33, p.268, 1988]. 
[0048] | n s tep 310, an original design block diagrams is defined 
to specify the interconnections between a existing channel 
or system H to be equalized, a equalizer Q to be de- 
signed, and one or a plurality of selected weighting filters. 
Fig. 1A shows as an example for designing a multi- 
objective post-equalizer, where both the gain from the 
exogenous input 1 w i to the exogenous output z, and the 
gain from the exogenous input 2 to the exogenous 
output z are desired to be as close to zero as possible. 



Fig. l B shows as an example for designing a multi- 
objective pre-equalizer, where both the gain from the ex- 
ogenous input w to the exogenous output 1 z , and the 
gain from the exogenous input w to the exogenous out- 
put 2 z 2 are desired to be as close to zero as possible. By 
rearranging block diagrams, all design block diagrams for 
pre-equalizers and post-equalizers can be transformed to 
a generalized equalizer design block diagram in Fig. 1C, 
where the exogenous input w, the exogenous output z, 
the equalizer output y, and the equalizer input u are in 
general all vector quantities. If an equalizer or an con- 
troller to be designed is involved in a feedback path, stan- 
dard Q-parameterization or Youla parameterization tech- 
niques for example in [S. Boyd et al, "A new CAD method 
and associated architectures for linear controllers," IEEE 
Transactions on Automatic Control, vol.33, p. 268, 1988] 
can be applied to transform the design block diagram to 
Fig. 2, where the stabilizer J maintains the stability of the 
overall system, while the stable equalizer is designed to 
optimize the closed-loop input-output dynamics. Fig. 2 
can be easily transformed to Fig. 1C since system 210 is 
equivalent to the system N. 
[0049] Once the design block diagram is in the form of Fig. ic, 



the exogenous output z is related to the exogenous input 
w as z = (N +N QN )w, where N is the sub-part of N 

zw zy uw zw 

transferring from w to z, N is the sub-part of N trans- 

z y 

ferring from y to z, and N is the sub-part of N transfer- 

u w 

ring from w to u. At every frequency, the equalized, 
closed-loop transfer matrix from w to z is (N +N QN ), 

zw zy uw 

which is convex in terms of frequency response of Qat 
the same frequency. A convex optimization problem can 
be formulated and solved to find the globally optimal so- 
lution of Q. 

[0050] Therefore in step 320, frequency-shaping specifications 
and the tradeoff between different input-output channels 
can be specified as convex objectives and convex con- 
straints when formulating a multi-objective optimization 
problem. For the pre-equalizer design example in Fig. IB, 
supposing every signal is a scalar quantity, (N +N QN ) 

zw zy uw 

is a two-by-one matrix. In fact, (N +N QN ) = M- 

7 zw zy uw 1,1 

HQ, and (N +N QN ) = Q. The notation (A) is used 

zw zy uw 2,1 i, j 

to represent the entry of a matrix A from its j-th input to 
its i-th output. It is desired to make both performance 
objectives denoted by f i (Q)=|M-HQ| and f (Q)=|Q| to be 
as closed to zero as possible. It is difficult to accomplish 
both objectives together unless M is zero as in a trivial 



case. Since both f^Q) and f^(Q) are convex, a standard 
multi-objective convex optimize technique is to optimize 
c f (Q)+c f (Q) where c and c are nonneqative and 

1 1 2 2 1 2 a 

cl+c2 = l. An explanation of this technique can be found 
in [S. Boyd et al, Linear Controller Design: Limits of Per- 
formance. Prentice-Hall, 1991]. A tradeoff curve between f 
i (Q) and f^Q) can be generated by solving with many 
combinations of and and then some engineering 
judgments and decision can be made to select the best 
tradeoff point. 

[0051] | n s tep 330, the frequency response data of N , N , and 

zw zy 

N can be incorporated in the multi-objective optimiza- 

uw 

tion problems without curve-fitting them first. 
Decoupling the Multi-object optimization problems 

[0052] | n one embodiment of the invention as shown in step 

420and step 440, the frequency response of the equalizer 
Q is first constrained to be real or nonnegative when opti- 
mizing the performance of different channels of (N +N 

zw 

QN ). For the previous pre-equalizer example f (Q)=|(N 

zy uw 1 

+N QN ) |= |M-HQ| andf (Q)=|(N +N QN ) 1 = 

zw zy uw 1,1 2 zw zy uw 2,1 

|Q|. Suppose only the magnitude of HQ is desired to 
match the magnitude of the reference weighing M at each 
of a set of selected frequencies, while ignoring there 



phase difference. Then f^Q) is replaced by 
f3(|Q|)=|M|-|H||Q|, and f2(Q) is replaced by f4(|Q|)=|Q|. 
Then a set of muliti-objective functions c f (|Q|)+c f (|Q|) 

13 2 4 

are defined at the selected frequencies, where c and 
are nonnegative and cl+c2 = l. After providing the fre- 
quency response data of N , N , and N in step 430, |Q| 

zw zy uw 

is optimized at each of the selected frequencies indepen- 
dently in step 440 . Alternatively, the phases of M and H 
can be preserved such that fl(Q) is replaced by 
f5(|Q|)=M-H|Q|. In general in each of the original objec- 
tive functions defined in step 320 on each of the perfor- 
mance channels of N + N QN , the argument Q is re- 

zw zy uw 

place by |Q| or constrained to be nonnegative. Each entry 
of N , N , and N may or may not be replaced by its 

zw zy uw 

absolute value or constrained to be nonnegative, depend- 
ing on some engineering judgments and choices. After 
this decoupling, each the of the resulting optimization 
problems has problem dimension much smaller than the 
original optimization problem formulated in the prior-art 
step 320. Thus this method is easy to be implemented in 
low-cost embedded computer systems, or can be imple- 
mented for real-time adaptive filter designs. 
Deriving Tradeoff Equalities from Multi-object optimization 



PROBLEMS 



[0053] | n another embodiment of the invention as shown in step 
5 20 and step 540, the frequency response of the equalizer 
Q is first constrained to be real or nonnegative, and a 
tradeoff performance equality at each selected frequency 
is defined for the performance of different channels of (N 
+ N QN ). For the pre-equalizer design problem in Fig. 

zw zy uw 

6B, supposing every signal is a scalar quantity, ( N zw + N 
QN ) i =l-W T (G | ) i Q,and(N +N QN ) = 1-W 

zy uw 1,1 T cl 1,1 zw zy uw 2,1 

u (G c| ) 2 X Q. Gel, which is system 610, represents an exist- 
ing feedback system. It is desired to optimize the equal- 
ized system output z l while minimize the actuating signal 

h 

z k entering the physical channel H. In this case, the two 
objectives are defined as f (Q)=|l-W (C ) Q| and f 
2 (Q)=|1-W (G ) 2 x Q|. Suppose at each of a set of selected 
frequencies, only the magnitude of w T ( G c| ) 1 X Q is desired 
to match the magnitude of its reference 1, and the magni- 
tude of 1-W (G ) Q is desired to match the magnitude 

U cl 2 ,1 3 

of its reference 1, while ignoring there phase difference. 
An alternative view of (N +N QN ) = 1-W (G ) Q 

zw zy uw 1,1 T cl 1,1 

close to zero is |W (G ) Q| < 1. An alternative view of (N 

T cl 1,1 

+ N QN ) = 1-W(G ) Q close to zero is |W(G ) 

zw zy uw 2,1 U cl 2 ,1 U cl 2 

Q| < 1. The < sign means close to, but no large than. All 



the possible combinations of |W (G ) Q| < 1 and |W (G 

K T cl 1,1 U 

) Q| < 1 are within square630, where the four corners 

cl 2 ,1 M 

are the desired solution points. However, the four desired 
solutions are not always possible unless l w T ( G c| ) 1 J = l w 
u (G c| ) 2 J. In general, a solution close to the boundary of 
square 630\s acceptable because it implies at least one of 
the performance channels is close to specification. The 
boundary of square 630can be approximate by any curves 
which are close to and are within the boundary. One of the 
possible choices is the unit circle within square 630. The 
resulting tradeoff performance equality is defined as 
1=(|W (G ) Q| 2 +|W (G ) Q| 2 ) 1/2 . After providing the 

T cl 1,1 U cl 2 ,1 K a 

frequency response data of N , N , and N in step 5 30, 

zw zy uw 

|Q| is solved at each of the selected frequencies indepen- 
dently in step 5 40.ln fact, any vector norm can be use to 
approximate square 630, and the resulting tradeoff per- 
formance equality is ^(IW^^Q^+IW^G^ 1 Q| P ) 1/P 
[0054] | n general, all the entries for the performance channels in 
N can be made to be no zero by augmenting a reference 

zw 

weighing for each performance channel, and then re- 
formulating (N +N QN ). Suppose there are N perfor- 

zw zy uw 

mance input-output channels, where N is a integer larger 
than 1, and for each performance channel with index i, 



the equalized response is (n ) +(n ) q, where (n ) is a 

1 i 2 i 1 i 

scalar, (n ) is a wide-vector, and q is a tall-vector con- 

2 i 

taining all the entries of Q at a selected frequency. The re- 
lation between Q and q can be found in [S. Boyd et al, "A 
new CAD method and associated architectures for linear 
controllers," IEEE Transactions on Automatic Control, 
vol.33, p. 268, 1988]. It is desired that the magnitude of (n 
2 ).q matches the magnitude of (n^.. This can be repre- 
sented by |(n ) q| < |(n ) |. Therefore, in the general N- 

2 i 1 i 

channel case Square 630 generalizes to an N-dimensional 
rectangular which defines the regions of acceptable solu- 
tions. An N-dimensional eclipse or a skewed N- 
dimensional norm ball can be defined to approximate the 
N-dimensional rectangular. Any set of |q| which satisfies 
any of these approximate surfaces is a candidate for ac- 
ceptable performance tradeoff. 
[0055] After this derivation, each the of the resulting perfor- 
mance trade-off equalities has problem dimension much 
smaller than the original optimization problem formulated 
in the prior-art step 320. Thus this method is easy to be 
implemented in low-cost embedded computer systems, or 
can be implemented for real-time adaptive filter designs. 
Recovering Phases Corresponding to a Stable System 



[0056] | n step 450 and step 550, the phases of the equalizer Q 
can be generated by applying efficient signal processing 
algorithms with the magnitudes computed from step 440 
and step 540 respectively, such that the magnitudes and 
phases correspond to a stable system. One such algorithm 
is the complex cepstrum describe in [A. Oppenheim and 
R. Schafer, Discrete-Time Signal Processing, 2nd ed. 
1999]. In this case, the magnitudes and phases corre- 
spond to a stable and minimum-phase system. 
Deriving Equalizer Coefficients 

[0057] | n s tep 4 6 0 and step 5 6 O.several algorithms can be used 
to derive equalizer coefficients from the computed mag- 
nitudes and phases. For example, since the computed 
magnitudes and phases correspond to the frequency re- 
sponse of a stable system, by computing their inverse dis- 
crete Fourier transform, a stable impulse response is gen- 
erated, which can be directly implanted as a finite-im- 
pulse-response filter. Model-reduction or curve-fitting 
techniques can be applied to the impulse-responses to 
find a lower-order filter for implementation. Similarly, 
model-reduction or curve-fitting techniques can be ap- 
plied to the magnitudes and the phases directly to find a 
lower-order filter for implementation. Some prior-art 



publications include [J. Juang, Applied System Identifica- 
tion, Prentice Hall PTR, 1994][V. Oppenheim et al, Dis- 
crete-Time Signal Processing, Prentice Hall, 1989] for the 
optimal approximation of finite-impulse-response filters, 
and [Kollar, Frequency Domain System Identification Tool- 
box, The Mathworks, Inc., 1994][ K. Liu et al "Frequency 
domain structural system identification by observability 
range space extraction," American Control Conference, 
vol. 1, Jun. 1994, pp. 107-111][ T. McKelvey et al, "Sub- 
space-based multivariable system identification from fre- 
quency response data," IEEE Transactions on Automatic 
Control, vol. 41, no. 7, Jul. 1996][ J. Juang, Applied System 
Identification, Prentice Hall PTR, 1994] for fitting fre- 
quency response data. 
An Implementation Example 

[0058] The design method following Fig. 5 has been tested in a 
real world application. Fig. 6A, Fig. 7A, Fig. 7B, Fig. 8A, Fig. 
8B, Fig. 9A and Fig. 9B are copied from [K. Tsai, et al "De- 
sign of Feedforward Filters for Improving Tracking Perfor- 
mances of Existing Feedback Control Systems," American 
Control Conference 2002, pp. 4988-4993] which is 
claimed in the Provisional Patent Application No. 
60/468,354, filed on May 6, 2003 for this invention, by 



the present inventor. Fig. 6£and Fig. 6Care copied and 
modified from their original version. 
[0059] Figure 6A is a prior-art block diagram showing a mixed- 
sensitivity H feedback control design problem, which 

00 

motivates the derivation of the method in Fig. 5. For ex- 
ample, in the mixed S/KS problem, where S denotes the 
closed-loop sensitivity function from w to z , and KS de- 

e 

notes the closed-loop sensitivity function from w to we 
choose two objective functions: f^K) = W s S = z^w, f 2 (K) 
= W u KS = z 2 /w, it is desired to achieve both If^KJI^y, and 
|f 2 (K)|<y for all frequencies, which can be simultaneously 
satisfied by (|f (K)| 2 + |f (K)| 2 ) 1/2 *y- This motivates the 
derivation of the tradeoff performance equalities. Figure 
6B is a block diagram showing an example for designing a 
multi-objective frequency-shaping pre-equalizer to im- 
prove the frequency response of an existing feedback-con- 
trol system, using the design method illustrated in the 
flowchart of Fig. 5. Figure 6C illustrates the similarity be- 
tween the mixed-sensitivity feedback control design in 
Fig. 6A and the multi-objective equalizer design of Fig. 5 
in Fig. 6B.. 

[0060] Figure 7A is a plot of the frequency response data of the 
existing feedback-control system 610 in Fig. 6B. In this 



case, system 610 represents a nano-positioning system 
driven by piezoelectric actuators. Since the existing feed- 
back controller K is implemented as analog circuits, both 
its input u and its output have physical limitation on 
their maximum amplitude. Therefore a control weighting 
filter W is selected to allow for the performance tradeoff. 

u 

Figure 7B is a plot of the designed magnitudes and phases 
of the pre-equalizer Q in Fig. 6B using the method of Fig 
5, and their low-order curve-fitting with a sixth-order 
stable and minimum-phase system. Figure 8A is plot of all 
the poles and zeros of the low-order curve-fitting sixth- 
order system in Fig. ZB, to confirm that all of them are 
within the unit-circle. Figure 8B compares a 
40-nanometer step responses of the original existing 
feedback control system, a 40-nanometer step responses 
of resulting equalized system, a the 40-nanometer step 
responses of the reference weighing W t . Figure 9A shows 
a 2-micrometer (2000-nanometer) step responses of the 
resulting equalized system, a 2-micrometer step re- 
sponses the reference weighing W t , and the magnitudes 
of the pre-equalizer output u. Because u is not taken into 
consideration originally, it is found that it peaks at 40 
volts which is much higher than its physical limitation 



which is 10 volts. Therefore the equalized output does not 
match the output of the reference weighting as well as the 
previous case with a much smaller 40-nanometer input. 
Figure 9 B shows the magnitudes of the pre-equalizer 
output u in the design example of Fig. 9B can be signifi- 
cantly reduced by designing a second pre-equalizer in 
front of the first pre-equalizer, and thus the equalized 
output match better to the output of the reference 
weighting with a 2-micrometer (2000-nanometer) step 
input. 
Conclusion 

[0061] what has been described is a method for fast design of 
multi-objective frequency-shaping equalizers. One em- 
bodiment for of the invention includes first constraining 
the frequency response of Qto be real or nonnegative, 
when optimizing the equalized transfer matrix N +N QN 

zw zy uw 

at each of a selected set of frequencies. This is equivalent 
with only optimizing the magnitudes of the equalizer fre- 
quency response. Then, the phases of the equalizer are 
recovered by efficient signal processing algorithms such 
as complex cepstrum, such that the magnitudes and the 
phases correspond to the frequency response of a stable 
system. In another embodiment, the frequency response 



of Q are first constrained to be real or nonnegative, and 
each selected frequency, an equality is defined to approx- 
imate the multiple requirements that a number of differ- 
ent entries of the equalized transfer matrix need to be 
close to zero. The magnitudes of the equalizer are first 
solved independently at each selected frequency, then the 
phases are recovered by efficient signal processing algo- 
rithms such as complex cepstrum, such that the magni- 
tudes and the phases correspond to the frequency re- 
sponse of a stable system. 



